-
Notifications
You must be signed in to change notification settings - Fork 224
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Support PEP 658/714 #1457
base: main
Are you sure you want to change the base?
Support PEP 658/714 #1457
Conversation
Hi @thejcannon! Thank you for your pull request and welcome to our community. Action RequiredIn order to merge any pull request (code, docs, etc.), we require contributors to sign our Contributor License Agreement, and we don't seem to have one on file for you. ProcessIn order for us to review and merge your suggested changes, please sign at https://code.facebook.com/cla. If you are contributing on behalf of someone else (eg your employer), the individual CLA may not be sufficient and your employer may need to sign the corporate CLA. Once the CLA is signed, our tooling will perform checks and validations. Afterwards, the pull request will be tagged with If you have received this in error or have any questions, please contact us at [email protected]. Thanks! |
@thejcannon considering that access to the bucket is public, do you mind sharing the output of this script somewhere (I can upload few .metadata files for existing wheels if you want) or point me to similar html file somewhere? Also, do you mind rebasing |
Hi @thejcannon, I'm sure you're taking time to contemplate after @matteius won the PR race (just joking, it was no race!), but all seems like now it's your time to shine! As the hashing logic is now in place, it shouldn't be too much work to include the hashes for metadata, too, right? I'd love to help, if your free time is scarce these days, but don't want to, you know, start any new race. |
Sorry, for the late response. I'm still very much planning on picking this up, but 2 weeks ago I was on vacation, and then paid the vacation price for it (COVID), so my "return to work" has been slow-going. |
Alright, I'm back on this today. Thanks for everyone's patience. @malfet I rebased. I probably should've asked as soon as I saw the message for you to upload some metadata files 🙈 |
OK @malfet free free to upload As far as existing examples go, if you look at https://pypi.org/simple/requests/ and grep for <a href="https://files.pythonhosted.org/packages/70/8e/0e2d847013cb52cd35b38c009bb167a1a26b2ce6cd6965bf26b47bc0bf44/requests-2.31.0-py3-none-any.whl#sha256=58cd2187c01e70e6e26505bca751777aa9f2ee0b7f4300988b709f44e013003f" data-requires-python=">=3.7" data-dist-info-metadata="sha256=7823e890e9db6f415138badf9744791290ef76e7ec6fd09a3789e8247fffe782" data-core-metadata="sha256=7823e890e9db6f415138badf9744791290ef76e7ec6fd09a3789e8247fffe782">requests-2.31.0-py3-none-any.whl</a> Note that PEP 658 says you can set the attribute to |
Alrighty, everything's been updated since the rebase, and now we set the attribute's value to the sha256 of the metadata file. Should be good to test it out. 🎉 |
Hi @thejcannon, I see the Meta crew has a lot to work on sideways 😒 |
IIRC my change just supports both for maximum compatibility. I'll take a closer look this week |
You're right! My bad, sorry. You even got in the OP... |
This change is meant to have the PyTorch package index support PEP 658 (and PEP 714) by accomplishing two things:
index.html
uses both PEP 658/714 tags to denote it supports metadata hostingtrue
since the S3 bucket doesn't have checksums uploaded (see Pip packaging and publishing improvements in pytorch wheels for better integration with poetry #1347 which is specifically about package checksums, but could be extended to metadata checksums)METADATA
file for any wheel is now uploaded to S3 alongside the wheels in all 3upload.sh
scripts (likely needs to be tested thoroughlyFuture improvements would be: